DOCVSENT BESUHJB 

BD 121 ei08 JC 760 252 



aOTHOE 
TITLE 

IHSTITOTION 

POB CaTE 
HOTE 



EDRS PEICE 
DESCSIPTOES 



IDEMIFIERS 



Bonjaain, Barbara Cohen; And Others 

Evaluating and Auditing a Community college Learning 

skills Center Program* 

Los Angeles City Coll*, Calif • : Los Angeles County 
superintendent of Schools, Califs 
6 Hay 76 

16p»; Paper presented to the Annual Conference of 
Educational Program Auditors and Evaluators (Oakland, 
California, Hay 6^ 1976) 

H?-$0»93 HC-$K67 Plus Postage 

^Basic Skills; Bibliographies; Community Colleges; 
Dropout Sate; ^Evaluation Methods; Indi^fidualized 
Programs; ^Junior Colleges; ^Learning Laboratories} 
Persistence; ^Program Evaluation; skill Centers; 
Tutorial Programs 
Los Angeles City College 



ABSTEACT 

The Learning skills Center <L3C) at Los Angeles City 
College is a^i individualized learning laboratory irhich offers 
assistance to students in communication skills and quantitative 
skills, and provides tutoring in all college-level courses* isc's 
programs are diagnostic and prescriptive, and services are available 
to students on both voluntary and referral bases* This document 
describes the establishment of an evaluation and managemeDt control 
system for LSC, and presents the results of the first evaluation* 
Basically^ the evaluation involved a comparison of dropout rates 
between those LSC students vho vere enrolled in basic English or 
{sathematics classes, and Los Angeles City College students irho had 
been involved in a baseline dropout study* The baseline persistence 
study showed a dropout rate of 42*8 percent for students in basic 
English. The dropout rates for the LSC program participants enrolled 
in basic English, on the other hand, were 16 percent for the fall 
semester and 6*6 percent for the spring semester of 1974-75* The 
baseline study showed a 45 percent dropout rate for basic 
mathematics^ as compared to 22.1 percent for the LSC participants 
during th^ fall semester and 10 percent for the spring semester* Data 
are organized into tables, and a bibliography of references for 
educational program evaluation and audit is appended* <Author/HHn) 
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INTRODUCTION 

The Learning Skills Center (LSC) at Los Angeles City College^ 
established In October, \S7^ through a Los Angeles Community 
College District grants Is an individualized learning laboratory 
which offers assistance to students In (I) coimnunlcatton skills, 
Including reading comprehension and speed, oral convnunlcatlon, 
functional writing problems, study skills, spelling and vocabulary 
development, and English as a second language" (2) quantitative 
skills. Including quantitative reasoning from basic arithmetic 
computations through trigonometry; and (3) tutoring In other 
college-level courses, literally from Anatomy and Zoology. 



HOW DOES THE LSC FUNCTION? 

Services to students are available on a voluntary and/or referral 
basis; they may come In on their own or couselors and Instructors 
may refer them to the LSC for specific skill development to 
reinforce coursework. Students may participate In the LSC for 
credit or noncredit and may enter and discontinue at any time during 
the year--In short, they may participate In an open entry/open exit 
program that Is diagnostic and prescriptive. If a student decides 
In advance that he wants to enroll In the LSC,. he may pre-enroll or 
go through the regular admissions procedure. If he decides at atny 
time during the semester that he would like to enroll In the LSC for 
credit, he Is eligible. (A student who chooses to do so may also 
participate In various LSC programs without credit.) 

When a student comes to the LSC, his language and mathematics skills 
are tested. On the basis of these diagnostic tests, a program Is 
prescribed for him tailored to his needs and designed to help develop 
his academic potentials. A subsequent test Is made 6 to 8 weeks later 
to see If the program Is working. If It Is not, a new prescription 
Is developed for him. Moreover, If a student has difficulty with LSC 
materials or with other coursework^ a tutor Is assigned to help him 
overcome other learning problems he may be experiencing. 

All students* work at the LSC is Individualized and self-paced (that 
Is, a student functions Individually In the learning skills program, 
taking as much time as he needs, whether It Is one week or several 
months). Helping to create a student's positive self-Image Is a 
fundamental thrust of the Individualized programs In the LSC (SUCCESS 
is built Into each of the programs). 

WHY DO AN EVALUATION AND AN AUDIT? 

The coordinator of the LSC decided to build an evaluation and manage- 
ment control system Into the operation for several reasons: (I) to 
provide a system of accountability, (2) to demonstrate to those 
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Interested what was happening In the LSC^ (3) to determtne what 
objectives and plans were appropriate for the Los Angeles City 
College campus^ Its students^ and faculty^ (k) to plan a definite 
course of action to structure an amorphous situation, because students 
and faculty were generally unknowrt quantities, and (5) to validate 
the LSC as a valuable operation. 

In searching for an independent auditor, the Dean of Instruction and 
the LSC coordinator discovered the Division of Program Evaluation, 
Research, and Pupil Services of the Office ef the Los Angeles County 
Superintendent of Schools, which has teams experienced In the areas 
of educational evaluation and audit and would provide their services 
free of charge. Not only was "free of charge" appealing to Los Angeles 
City College and its district office, but It also meant that It would 
be objective and impartial, with no conflict of Interests. This was 
Crucial to establish the credibility of the LSC because the faculty. 
In general, opposed a LSC on campus and were skeptical about what a 
LSC might do that they could not or were not already doing In their 
class rooms. 

Interestingly, the faculty relaxed when they heard that an evaluation 
system was but It Into the LSC operation because they could not Imagine 
what sane person would want that much accountability. The ones who 
turned out to be nervous about evaluation and audit were the LSC^s 
Own workers, both evening faculty and student tutors. However, when 
Che LSC faculty and student workers discovered that evaluation was a 
simple process, that It could change during the year, and from year 
to year to more appropriately fit the needs of the Los Angeles City 
College students^ they relaxed, too. 



WHAT WERE THE OUTCOMES? 

The outcomes of the LSC program evaluation and audit were of two 
different types. White the first type was concerned with the LSC 
program specifically, the second type was more general In that It 
had an Impact on personnel and decisions outside the LSC program. 

At the LSC program specific level, there were four results: 

S. When compared to baseline persistence data» concurrent 
attend:jnce In basic math department courses and the LSC 
was a<isoclated wi th significantly lower (p<.OOI) dropout 
rates for both the Fall and Spring Semesters of }S7^^75* 

S. When compared to baseline persistence data^i concurrent 

attendance )n basic English department courses and the LSC 
was assocf ated wi th significantly lower (p^.OOl) dropout 
rates for both the Fall and Spring Semesters of }97^^75* 

3. Seventy-eight point nine percent (78. 9t) of all LSC users 
were EOP&S qualified. 
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4t More than stxty-ftve percent (65, Ot) of the LSC users wef@ 
declared vocational education majors. 

Because significant levels such as those which were presented above 
for numbers t and 2 have a way of "forgetting where they came fro/n^'^ 
the reader Is entitled to a brief descriptive statement of the rationale 
behind the dropout comparisons, the quasl^experimental research design 
that was used, and the statistical procedures that were employed. 

Of course, when the LSC program was created^ It was hoped that students 
who participated In the program would perform better academically than 0 
those who did not participate. But at that point a question emerged, 
"How could their academic performance best be Judged?^' The subsequent 
search for the most meaningful definition of academic performance led 
to the identification of a "staggeringly high dropout rate" as the 
number one problem that needed to be solved In those early stages of the 
development of the LSC program. Fortunately for the evaluation team of 
the LSC, a very comprehensive study of persistence rates in basic Engllshi 
basic mathematics, and other classes had been conducted by Or. Ben Gold^ 
Director of Research, Los Angeles City College. 

tt was decided that the LSC program would Include an evaluation compar- 
ison of dropout rates between those LSC students u/ho not only partici- 
pated in the LSC program but also enrolled In basic English and/or 
basic mathematics classes and those who had been Involved In the Ben Gold 
baseline dropout study. Accordingly, this a priori , planned comparison 
was written Into the LSC program evaluation and audit plan as program 
objective k,0 (shown in appendix I). Clearly, then, the comparisons 
that were made were not made within the "true experimental designs" 
category described by Campbell and Stanley (D. T, Campbell and 
J. C. Stanley* 1968). 

For purposes of this comparative Investigation of dropout rates, the 
dropout rate in "Total English classes" was operationally defined as 
the dropout rate for the total group of students who were In English 61, 
62, 6^, 65, and 66. In other words, students In all five English classes 
were confined as one basic '^otal English^' group. Using this definition^ 
the baseline persistence study by Ben Gold showed that ^88 out of 1,13^ 
students who enrolled In these five basic English classes withdrew 
(earned a "W") In the Fall semester of 1971- These figures produce e 
baseline dropout rate In basic "Total English" of for the Fall 

semester of 1971. It was this high dropout rate that, it was hoped, 
would be at least partially reduced by participation In the LSC program, 

Simllarlyo the dropout rate In basic "Total Mathematics" classes were 
operationally defined as the dropout rate for the group of students who 
were tn Mathematics 30 and 31 > Ben Gold's study showed that 397 out of 
883 students who enrolled In these two basic Mathematics classes with- 
drew (earned a *'W") In the Fall of 1971* These figures produce a 
baseline .dropout rate In basic, total Mathematics of ^5.0%. Again, It 
was hoped that this high dropout rate could be reduced by participation 
In the LSC program. 
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So the basettne persistence study contributed a priori dropout rates 
of ^2.8% In basic total English and k^,0% (n basic total Mathematics* 
What data were available on students who both participated In the ISC 
program and who were In one or more basic English or basic Mathematics 
class? Two semesters worth of data were available on those LSC 
participants; data were available for both the Fall and Spring semesters 
of the 197^-75 academic year. 

A very sharp contrast emerged when the dropout rates of LSC participants 
were compared to the baseline dropout rates^ The baseline study showed 
that kZ.8% dropped out of total baste English* In sharp contrast, the 
dropout rates for total basic English for the LSC program participants 
were 16.0% for the Fall semester and 6.56% for the Spring semester of 
197^*-75. 

The baseline dropout study showed that ^5*0^ dropped out of total 
basic Mathematics. Again, a sharp contrast^-^the dropout rates In totsl 
basic Mathematics for the LSC participants were 22.1% for the Fall 
semester and 10.0% for the Spring semesterp 197'}~75< 

That these comparative dropout rates are significantly different 
statistically can be seen In the display that follows. In aW cases, 
the significance levels exceed the p^.OOI level. 
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DISPLAY 1 



RESULTS OF STATISTICALLY TESTING THE FOUR HYPOTHESES OF 
"NO DIFFERENCE" IN ATTRITION RATES BETWEEN 
TOE TWO GROUPS OF IDENTIFIED STUDENTS 



DATA ANALYSIS 



HYPOTHESES BEING TESTED 



(1) 



erJc 



There is no difference 
between the total English 
dropout rates of the students 
who participated in the 
Learning Skills Center Prog- 
ram In the Fall semester and 
of the students in the base- 
line persistence study. 



(2) There is no difference 
between the total, basic 
English dropout rates of the 
students who participated in 
the Learning Skills Center 
Program In the Spring 
semester and the students 
in the baseline persistence 
study. 



TOTAL SAMPLE SIZE, NUMBER, AND PERCENTAGE OF STUDENTS WHO DROPPED OUT 



LEARNING SKILLS 
CENTER PROGRAM 



TOTAL 

SAMPLE 

SIZE 



75 



61 



12 



16.0 



6.65 



BASELINE PERSISTENCE 
STUDY 



TOTAL 

SAMPLE 

SIZE 



1,134 



N 



488 



1,134 



488 



St 



42.8 



TEST 
STATISTIC 



S VALUE 



4.6 



42.8 



5.6 



SIGNIFICANCE 
LEA^L 



P VALUE 



PS ,0002 



Pi .000001 
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DATA ANALYSIS 



1 

HYPOTHESES BEING TESTED 


TOTAL SAMPLE SIZE, NUMBER, AND PERCENTAGE OF STUDENTS WHO DROPf^ED OUT 


LEARNING SKILLS 
CENTER PROGRAM 


BASELINE PERSISTENCE 
STUDY 


■resT 

STATISTIC 


SIGNIFICANCE 
LEA^L 


TOTAL 

SAMPLE 

SIZE 


N 




TOTAL 

SAMPLE 

SIZE 


N 


% 


Z VALUE 


P VALUE 


C3) There is no difference 

between the total mathematics 
dropout rates of the students 
who participated in the 
Learning Skills Center Pro- 
gram in the Fall semester and 
of the students in the base- 
line persistence study. 


95 


2i 


22.1 


883 


397 


45.0 


4.28 


P^.0OO4 


(4) There is no difference 
between the total, basic 
Mathematics dropout rates of 
the students who participated 
in the Learning Skills CenteT 
Progi^am in the Spring 
semester and the students in 
the baseline persistence 
study. 


90 


9 

■ 

1 

1 


10,0 

1 

1 


883 


397 

1 


45.0 


6.4 


P^ ,000001 
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Because this comparattve Investigation of dropout rates Is an example 
of a Quasl-^experlmenta) study (0. T. Campbell and J. C. Stanley* 1968), 
It cannot be said that participation tn the LSC program at Los Angeles 
City College causes or results In lower dropout rates In total baste 
English and total basic Mathematics.' However, because this Investl^ 
gat 1 on Is an example of an associ at tonal s tudy , 1 1 can be said that 
participation In the LSC program at Los Angeles City College Is 
associated wl th significantly lower dropout rates In total basic 
English and total basic Mathematics (James Popham, 1969). And, because 
Such program participation is associated with significantly lower drop** 
Out rates, It Is important that the salient elements of the program be 
described and that the description be made available to other profes' 
sionals in this field. 

On a general level, there were some Interesting spinoffs. The Curriculum 
Committee, responsible for recommending which courses should be accepted 
or rejected by the Academic Senate, demanded that all new course out* 
lines be written In terms of performance objectives so that students 
could know exactly what was expected In the course. Furthermore, the 
Curriculum Committee notified all Instructors that course outlines must 
follow a management by objectives format if they were to consider the 
proposed course for approval. 

Some of the most significant outcomes can be described best In terms of 
Individual cases. One twenty-eight year old male student who had tested 
OP the second grade level equivalent In October, advanced to the 7,5 
grade level equivalent when he tested In June. At first he could not 
believe that the time he devoted to his program at the LSC had worked. 
To test it he decided to take his driver's test. On July 3 he came 
dancing into the LSC to proclaim that, "i don't have to look over my 
shoulder whi le driving anymore. I got my driver's Ucensel" S. V. had 
learned to read at a high enough level to pass the test to drive legally 
in California. That atso meant he could get a job, probably be successful 
in other courses on the campus, and be proud of his accomplishments. 

J. B., a thirty-eight year old mother of four teenaged sons, was notified 
on Hay 20 that she was failing her Algebra class and could expect to 
have to repeat It in Summer School. The LSC provided her with a math 
tutor for one hour daily, from May 20 until, the first week of June when 
her final exam had to be taken. She received 100% on the final exam, 
the highest grade In the class, and earned a grade of ^'B*^ in the course. 

A. 8., a female student fifty-five years of age from Peru, was rejected 
from an English 60 series class In Summer School. (English 60 series 
was established to help students with writing problems before they could 
take English 1 J She was Informed that she had failed the writing exam 
snd that she had also failed to qualify on the reading exam required 
for English 60 series courses. She came to the LSC. A tutor was 
assigned to work with her In writing and she was tested for the reading 
program* A. B. was required to work six hours a week In the, LSC during 



Students were not randomly assigned to either participate in the LSC 
program or not participate, in fact, of course, the groups of students 
attended Los Angeles City College at different times. 
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Sufrewer School for three credits* After that she took the EnglUh 
screening test« scored )2.8 In reading and was successfully enrolled 
I n Engl Ish I . 

Ftnaily, there is S. S., an eighty year old woman Mho came to the 

LSC In Summer School 1975 because she could not read. She dtd not 

even know the alphabet. Her husband had died recently and S. was 

on her own. She didn't know how to write a check to pay her rent. 

She could not even print! She had figured out numbers by herself 

because she had to use the phone and the bus If she wanted to get 

around, and . . there Is no way," she said that she,, . , could teach 

herself to read where the buses were going.'* S. S. learned the 

alphabet, the sounds of a)) the letters, and how to read simple words 

and sentences !n five months. 

Stories like the above can be heard almost dally around the LSC. To 
paraphrase Timothy Manning, an evangelical preacher In the Arnerlcan 
colonies In the early )700's, "It doesn't matter how you ge^. a student 
to learn, as long as you get him there." And a built-in system of 
evaluation and audit reveals that Los Angeles City College's Learning 
SklUs Center !s getting students "there^ where It Is happening." 
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